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Abstract 

We reconsider the one-step replica-symmetry-breaking (IRSB) solutions of two random combina- 
torial problems: /c-XORSAT and fc-SAT. We present a general method for establishing the stability 
of these solutions with respect to further steps of replica-symmetry breaking. Our approach extends 
the ideas of Ref. [1] to more general combinatorial problems. 

It turns out that IRSB is always unstable at sufficiently small clauses density a or high energy. 
In particular, the recent IRSB solution to 3-SAT is unstable at zero energy for a < a^, with 
am ~ 4.153. On the other hand, the SAT-UNSAT phase transition seems to be correctly described 
within IRSB. 
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I. INTRODUCTION 



It is well known that there are two possible structures for the low-temperature phase of 
mean-field spin glasses [2]. The first scenario is described, within rephca theory, by a IRSB 
ansatz. It corresponds to the existence of an exponential number of pure states which are, 
roughly speaking, uncorrelated. In the second scenario, a large number [29] of pure states is 
organized in an ultrametric tree. The tree describes the probabilistic dependencies among 
the free energies and the distances of different pure states. This probabilistic structure 
corresponds, in replica jargon, to a full replica symmetry breaking (FRSB) ansatz. 

In the last 20 years many combinatorial problems have been successfully analyzed using 
the well known mapping onto disordered statistical physics models [2, 3]. The same two 
scenarios are expected to be present within this domain. However, because of the rich 
structure of many combinatorial problems, their analysis has been so-far limited to IRSB 
calculations. It is therefore of the utmost importance to analyze the consistency of the IRSB 
solutions. An important check consists in looking at a neighborhood of the IRSB subspace 
(in the larger FRSB space) and verify the "local stabihty" of the IRSB solution. 

Such a computation has recently acquired a further reason of interest. As shown in 
Ref. [1], even in situations in which the equilibrium behavior is correctly treated within a 
IRSB ansatz, non- equilibrium properties generically require a FRSB description. In fact, it 
turns out that high- lying metastable states are unstable towards FRSB. In a combinatorial 
optimization context "equilibrium properties" are related to the cost of the optimal solution. 
"Metastable states" are, possibly, related to the dynamics of local search algorithms [4] . 

There are two possible instabilities of the IRSB calculation [1]. If we think of the IRSB 
solution as describing the decomposition of the Gibbs measure in many, well-separated pure 
states, the following scenarios are possible: (I) The states organize themselves into clusters, 
forming an ultrametric FRSB structure; (II) Each state splits into many sub-states forming 
an FRSB structure. In Fig. 1 we present a pictorial interpretation of these two instabilities. 
Type-I instability usually occurs at low energy, and often below the ground-state energy. In 
this case it is irrelevant from a statistical physics point of view. The calculation of Ref. [5] for 
3-SAT was related to type-I instability, and confirmed the irrelevance of this phenomenon. 
Type-II instability affects always the high-lying metastable states and, in some regions of 
the phase diagram, even the ground state. Here we shall compute the threshold for this type 
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FIG. 1: A pictorial view of the two types of instabilities of the IRSB solution. Blobs represent 
pure states or clusters of states. 

of instability. 

In this paper, we shall focus on satisfiability problems, and in particular treat the special 
cases of A;-XORSAT and fc-SAT. These are problems in which a large number of boolean 
variables have to be fixed in such a way to satisfy a set of constraints (clauses). /c-SAT lies at 
the very heart of theoretical computer science. It is, in fact, one of the first problems which 
have been proved to be NP-complete (the first being its irregular version: SAT) [6]. A large 
effort has been devoted to the study of the SAT-UNSAT transition in random k-SAT [7, 8] . 
The IRSB solution of this model has been a quite recent achievement [9, 10]. /c-XORSAT 
is somehow simpler than A;-SAT (both from the analytic and the algorithmic point of view) , 
while sharing a similar phase diagram [11, 12]. Interestingly, its IRSB solution has been 
proved to be correct in the zcro-cncrgy limit [13, 14]. 

Since we are mainly interested in combinatorial problems, we shall focus on zero- 
temperature statistical mechanics. In the main part of our paper we fix T = since the 
beginning of our calculations. It is however instructive to solve the problem (in IRSB ap- 
proximation) at finite temperature and let T — > afterwards. It turns out that the instability 
of the T = IRSB solution is refiected in an unphysical behavior of the finite temperature 
solution in the T — > limit. This provides an useful check of our calculations. 

The paper is organized as follows. In Sec. II we explain how the instability of the IRSB 



3 



phase can be derived from an analysis of the two-step rephca symmetry breaking (2RSB) 
saddle-point equations. We describe our method for a general satisfiabihty model. In Sec. Ill 
we specialize to two prototypical cases: random fc-XORSAT and random fc-SAT, and show 
the results of a numerical evaluation of the stability condition. We discuss the consequences 
of our findings. In Sec. IV we consider the finite-temperature IRSB solution. We compare 
the behavior of this solution in the T ^ limit and the stability thresholds computed in 
the previous Section. In Appendix A we collect the explicit formulae for the stability of 
/c-XORSAT and /c-SAT. Finally in App. B we expand around the dynamical transition of 
/c-XORSAT, in order to have an analytical characterization of this transition. 

II. THE GENERAL APPROACH 

In this Section wc consider a general model over N Ising spins = ±1, i G {!,..., N}. 
The Hamiltonian is the sum of M = aN terms, each one being a /c-spin interaction (we 
shall be interested in the case A; > 3). We use the indices a, 6, c • • • e {1, ■ ■ ■ M} for the 
interactions, and denote by da — {i", . . . the set of sites entering in the interaction a. 
Conversely di will be the set of interactions in which i participates. With these conventions 
the Hamiltonian reads 

M 

H{a) = J2Ea{^a), (1) 

a=l 

where we used the vector notations a = (o"i, . . . , ajy) and o_q^ = (ajj, . . . , (jjo). The functions 
£"„(•) may (eventually) depend upon some quenched random variables which we will not 
note explicitly. Each interaction (clause) Ea{-) can take two values: either (the clause is 
satisfied) or 2 (unsatisfied). 

A nice graphical representation of such a model is obtained by drawing a factor graph 
[15], cf. Fig. 2. This is a bipartite graph with two type of nodes: variable nodes, and clause 
nodes. An edge is drawn between the clause a and the variable i if i E da (or, cquivalcntly, 
a E di). A crucial property for mean field theory to be exact is that the factor graph must 
not contain "short" loops. 

Let S be the space of probability distribution p = (p+, po, p_) over the set {-|-, 0, — }. Ge- 
ometrically S is the two-dimensional simplex. The zero-temperature 2RSB order parameter 
for the model (1) is given by a distribution over S for each directed link of the factor graph. 
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FIG. 2: A fragment of a factor graph. Squares represent clauses (interactions) and circles represents 
variables (spins). Variable nodes are connected by a link to the clauses they belong to. Cavity 
fields (and their distributions) are associated with directed edges. 

We shall denote such distributions by Qi^a[p] (if the link is directed from a variable node 
to a clause node) or by Qa-^i[p\ (in the opposite case). The 2RSB cavity equations for such 
a model have the general form 

Qi-^a[p] = ^1 lldQt>^^\-P^'^] z[{p^'^■,^i,r/^^ s[p - p^[{p^'^; , (2) 

b^di\a 

Qa^m = / n ^^^---[^^'^l ^[P-mP^'^E: (3) 
jEda\i 

where /xi and //2 are the zero-temperature Parisi parameters and satisfy the usual inequalities 
< /ii < /i2- They are related to their finite-temperature counterparts mi and m2 as follows: 
fii = limx^Q mi(T)/T. The integrals in Eqs. (2), (3) run over the simplex S. The delta- 
functions are understood to operate on the same space. 

The function . . .p^^^-^)] (h ere "c" stands for "cavity") is model-dependent. We 

will recall in App. A its precise form for the models treated in Sec. III. The functions 
p^[jo^^^ ■ ■ ■ P^'^; A*2] and z[p-^^ . . . p^'^; /i2] are, on the other hand, universal. They are defined 
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as follows 

1 ' 

where = {(gi ■ ■ ■ qi) : ^^Qi > 0}, = {(^i ■■■Qi) ■ T^iQi ^ 0}, and Q_ = {(gi . . . g/) : 
J^iQi < 0} (with Qi e {+,0,-}). The normalization z[{p^^; 112] is fixed by requiring 
p% + Po + P- — 1- Hereafter we will use the symbols q,qi,q' . . . for variables running over 

the set {+,0, -}. 

In order to select a type-II instability [1], see Sec. I, we shall consider order parameters 
which concentrate near the "corners" of the simplex S: 6^+\ S^^\ 6^-\ The corner distri- 
butions are defined by: 5'^^ — 1 ii q — q' and otherwise. We can decompose such order 
parameters as follows: 

Q.^alp] = rtlQllip] + rSaQSaH + rtiQ^itip] , (5) 

where the distributions Q^llaip] Qa^iiPl supposed to be normalized and concentrated 
near S^'^\ We parametrize the "width" of these distributions using the 6 parameters for each 
directed link: 



with analogous definitions for the parameters ei*^^ and e^^j. Notice that the the (— l)'^'''' 
pref actors have been properly chosen to make the e^^^, e^^'^ positive. 

It is easy to see that the recursions (2), (3) preserve the subspace {Q,Q : e^-!^^ = 'ef}^ — 
for any i, a, q}. This is in fact a possible embedding of the IRSB solution in the 2RSB space. 
Of course the parameters r|£„ and f^'^j must satisfy, in this case, the IRSB equations: 

Vi^a = P''[{rb-^i}beai\a; Pi] , K-^i = p^[{rj-^a}jeda\i\ ■ (8) 

In order to check the stability of the IRSB subspace, we must linearize Eqs. (2) and (3) 
for small e\'^, e^^-^- "^^^^ yields equations of the form 

4t « E E Tt2^i<l, <^w, ^ , (9) 

b£di\a q',<T' 

-EE ^rlaiM, <^W, e^^ , (10) 

jEda\i q',<7' 



where a, a' E {+, -}. The 6 x 6 matrices and can be computed in terms of 

the cavity functions p^[. . p^[- ■ ■] and of the IRSB solution, cf. Eq. (8). For instance, 
expanding Eq. (2) we get: 

<lb=<l' 

where 

^,[{fe^,};/ii]= Yl n ^c'ie-''^^S='''='~'^='='^- (12) 

{gc}&^q cedi\a 

The matrix Af^'']./({?c}; /^2) is obtained by hnearizing the cavity function . . .p-''^; ^2], 

cf . Eq. (4) , near the corners of the simplex: 



dpi dpi 



(13) 



p{i)=5i9i) 

Notice that the expression (11) depends explicitly both on jii and and, through f^!^j, on 
Pi. However, it can be shown that the dependence on p2 cancels if the stability condition is 
considered. We can therefore identify pi with the IRSB parameter p. 

Let us now discuss how Eqs. (9), (10) can be used to determine whether the IRSB solution 
is stable. The idea is to implement these recursions, together with Eq. (8), as a message- 
passing algorithm [16]. One keeps in memory the value of the IRSB order parameter ri^a 
(or Ta-^i) and of the 6 fluctuation parameters e^-^^ (or e^^'^) for each directed link. At each 
iteration these values are updated using Eqs. (8)-(10) for all the links of the graph (one 
should imagine the old values to be used on the right hand side and the new ones coming out 
on the left hand side). The matrices T^'fli and tJ^^ must be recomputed after each sweep 
in terms of the most recent values of ri_>o and fa_^j. After a fast transient the numbers ri_>a 
and fa_>j converge to the IRSB solution. As for the e-£^ and e^^'^, either they converge to 
or they stay different from (and, in fact, diverge). In the first case the IRSB solution is 
stable, in the second one it is unstable. 

The above procedure can be improved in several aspects. First of all one can define (and 
monitor) an appropriate norm of the e's, e.g. 

N 



^ZZEkSx (14) 



i=l a€di q,(7 



After each updating sweep one can renormalize the e's by setting A = ||e|| and e\'^ 
eHa/'^- "^^^ IRSB solution is stable if A < 1, and unstable otherwise. It is evident that A 
converges to the largest eigenvalue of the linear transformation (9), (10). The determination 
of the "stability parameter" A can be improved by averaging it over many iterations of the 
algorithm. 

In the next Sections we will be interested in evaluating the stability threshold for en- 
sembles of models. In this case one can implement the same algorithm as before drawing 
the local structure of the graph randomly at each iteration [17]. Moreover, by cleverly ex- 
ploiting the structure of the model to be studied, one can reduce the number of fluctuation 
parameters e, e~per link. In both the examples to be studied below, it is possible to use just 
one parameter e and one 'e per link. 

As a final remark, let us notice that the method outhned in this Section for T — 0, can 
be generalized to finite-temperature calculations [18]. 

III. NUMERICAL EVALUATION OF THE STABILITY CONDITION 

In this Section we treat two ensembles of satisfiability models having Hamiltonians of 
the form (1): random /c-XORSAT and random /c-SAT. In both cases the A:-uple of sites 
(i" • • ■ it) involved in a given clause a is chosen with fiat probability distribution among the 
(■^) possible /c-uples. 

The zero-temperature phase diagram of these models (for A; > 3) is known [7-10, 12-14] 
to be composed by 3 different phases as a function of a, cf. Figs. 3 and 4. For a < a^x the 
system is paramagnetic with no diverging energy barriers in the configurational space. For 
ttd < < etc the model is still unfrustrated: the ground state energy is zero. Nevertheless 
the Gibbs measure decomposes in an exponentially large number of pure states separated 
by large energy barriers. For a > ac frustration percolates and the ground state energy 
becomes positive. The ground state is still hidden within a large number of metastable 
states. 

Within the IRSB approximation, the system is completely described by the complexity 
E(e), i.e. the normalized logarithm of the number of metastable states with energy density 
e. For a > a^, the complexity becomes strictly positive in the interval e e [es{a),ed{o()]- 
The static energy es{a) vanishes for a < etc and becomes positive above the static transition 
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FIG. 3: The stability region in the energy-clause density plane for 3-XORSAT. We used population 
dynamics algorithms with O(IO^) elements and O(IO^) iterations. The marginal stability line eoia) 
crosses the one-step ground state energy es{a) at ac = 3.072(2) (outside the range shown here). 

point etc. The IRSB dynamical energy e^, becomes positive at the dynamical critical point 

The IRSB calculation of E(e) becomes quite generally [1] unstable with respect to further 
replica- symmetry breakings above the Gardner energy cq, with cq < e^- We expect the 
IRSB result to be correct only for e < cq. In the following we shall present our results for 
60(0;) obtained with the method outlined in the previous Section. 

A. A;-XORSAT 

The definitions given so far are completed by taking 

Eaioida) = JaCTil-'-Cni, (15) 

where the J^'s arc i.i.d. (quenched) random variables taking the values ±1 wdth equal proba- 
bilities. We recall [11, 12] that the existence of an unfrustrated ground state can be mapped 
onto the existence of a solution for a certain random linear system over GF[2]. 

In Fig. 3 we present our results for the zero temperature phase diagram for A; = 3 (but 
the picture remains qualitatively similar for any k). For A; = 3 we have ^ 0.81846916 
and etc ~ 0.91793528. It is evident from the data of Fig. 3 that < eG{a) < ed{a) for 
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a > did, and that 60(0;), ed{a) J, as a J, ad- This is confirmed by a perturbative expansion 
for a — > ad, cf. App. B. In particular we get 

ed{oc) — ef\a — ad)^^^ + 0{a — ad) , 60(0;) = eQ\a — ad) + 0{{a — ad)^^^) , (16) 

with e[,°^ !^ 0.0107506548 and ej?^ ^ 0.0753987711 for k = 3. Let us stress that our result 
60(0;) > for q; > ccd is consistent with the rigorous solution of the model at e = [13, 14]. 

In the limit a — > 00 we expect to recover the fully connected /c-spin Ising spin glass. At 
zero temperature this model is characterized by FRSB even for what concerns the ground 
state concerns [19]. This imphes that the hne eda) must cross es(a) at some finite ac- This 
expectation is in fact fulfilled by our data: we get aQ = 3.072(2) for k = 3. For a > ac the 
IRSB result for the ground state energy is just a lower bound [20] . 

B. A;-SAT 

In this case the energy of a clause is 

Eaia,J^2l['-—^, (17) 

where the Ja-*i are i.i.d. (quenched) random variables taking the values ±1 with equal 
probabilities. The clause has energy 2 (it is not satisfied) if all of participating spins cTj have 
opposite signs to the corresponding Ja^i- In all the other cases it has energy (it is satisfied). 
In Fig. 4 we show the results of our method for the stability threshold CQ^a), together with 
the curves for es{a) and ed(a) computed in Refs. [9, 10]. We considered the two prototypical 
cases k — 3 and k — 4, but we expect the picture to remain qualitatively similar for any 
A; > 3. There is an important qualitative difference with respect to /c-XORSAT: for /c-SAT 
60(0;) i for a J, a^a with ad < a^a < ckc- In other words even zero-energy states become 
unstable towards FRSB at sufficiently low a. In the IRSB picture, zero-energy states are 
related to cluster of solutions of the corresponding satisfiability problem [8-10]. It would 
be interesting to understand how this picture must be modified below a„^. Generalizing the 
ideas of [1], we expect, within a 2RSB description, such clusters to split continuously into 
sub-clusters at ctm- 

Unhke /c-XORSAT, the stabihty computation has a non-trivial result even at zero-energy. 
It is therefore interesting to modify the approach of Sec. II in order to consider this limit 
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FIG. 4: The stability region in the energy-clause density plane for 3-SAT (top) 4-S AT (bottom). 
Here we used population dynamics algorithms with (typically) O(IO^) elements and O(IO^) itera- 
tions. 

case. The zero-energy limit of the 2RSB equations (2), (3) is obtained by taking fii, fi2 ~^ ^ 
with /ii//X2 = X fixed. As already noticed in Sec. II, the stability parameter A ends up not 
depending upon 112, and therefore x. We report our results for X{a, e = 0) in Fig. 5. 
This approach provide us good estimates of ctm- We get ctm = 4.153(1) ior k — 3 and 
CKm = 9.086(2) for k — A. This should be compared with the values a^, — 3.925(3) and 
Qjc = 4.266(1) for - 3, and = 8.295(6) and = 9.931(2) for A; = 4. 

Finally, in the large connectivity limit, the IRSB solution is unstable even for the ground 
state. The curves 60(0;) and es{a) cross at ac- We get ac = 4.390(5) for A; = 3 and 
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FIG. 5: The stability parameter (largest eigenvalue of the stability matrix) A(a, e = 0) for 3-SAT 
(left) and 4-SAT (right). 

ao = 11.00(2) for A; = 4. 



IV. ON THE ZERO-TEMPERATURE LIMIT OF THE IRSB SOLUTION 

In this Section we consider the finite-temperature IRSB solution and discuss its T — > 
limit. At finite temperature the IRSB order parameter is given by a probability distribution 
over the reals for each directed link. We shall call these distributions Pi^a{h) and 'pa^i{u). 
The variables u and h are "cavity fields". If the factor graph were a tree, we could define 
the cavity fields as follows. Consider the branch a — > i of the graph: this is the connected 
sub-tree which has i as the root and contains only a among the neighbors of i. Let Za_,j((7j) 
be the partition function for this subsystem constrained to a given value of (jj, at inverse 
temperature /3. This quantity can be parametrized in terms of a cavity field Ua^i as follows 

Z„^,(<j,)=zS,e^"«-'^V (18) 

It is now elementary to show that, if the Hamiltonian has the form (1), with Ea{g^g) taking 
values in {0, 2}, the field Ua-^i must become an integer number when T — > 0. The same 
conclusion is easily reached for the fields /ij-^a- 

The situation is less clear on locally tree-like graphs, such as the ones considered in Sec. 
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III. However, one can argue that the same property of the T — > hmit must hold within each 
pure state. Suppose now that the IRSB cavity fields distributions pi^a{h) or pa-^i{u) have 
a non- vanishing support over non- integer fields even in the T ^ limit. It is reasonable 
to take this as an evidence for the IRSB ansatz being incorrect (this kind of argument 
was pioneered in Ref. [21]). In fact we do not expect the properties of the system to be 
discontinuous at T = 0. 

Let us notice in passing that other interesting phenomena appear when T > 0. At 
infinitesimal temperature the cavity fields acquire a small part proportional to the tempera- 
ture. These evanescent contributions can in turn undergo one or several replica-symmetry- 
breakings transitions [8]. This is what happens in 3-SAT above ~ 3.87 < [22]. The 
underlying physical phenomenon is the following. In the region < a < a^^ the space of 
solutions decomposes into clusters. However these cluster do not have any backbone (i.e. 
a subset of the variables which is fixed in all the solution of the cluster). The backbone 
percolates at a^- In this Section we focus on "hard" cavity fields (i.e. non-vanishing in the 
zero-temperature hmit) and these effects do not concern us. Notice that "hard" fields are 
the ones determining the energy in the T — > limit. 

It is easy to understand why a cavity fields distribution not concentrated on the integers in 
the T ^ limit, should be related to the instability of the IRSB solution. Indeed the effect 
of the finite temperature is to provide fields that are not integers but differ from integers by a 
term of order T. When we insert these slightly-non-integer fields in the cavity equations this 
perturbation may be amplified, and after a finite number of steps the distribution may spread 
over non-integer fields. This instability corresponds to the propagation of a perturbation at 
any distance and it is a signal of instability of the IRSB solution. 

We investigated this phenomenon analytically for /c-XORSAT and /c-SAT. The idea is to 
write the IRSB order parameter as follows 

Pa^iiu) = ritlAu - 1) + ^:iAu) + TtlAu + 1) + + tli^) , W 

and analogously for Pi^a{h), with e^l^j('u), e^l]j(M) small perturbations supported, respec- 
tively over (0,1), and (—1,0) (it turns out that \u\ < 1 always). We then considered the 
T — cavity equations with IRSB parameter p. It is easy to realize that the IRSB equa- 
tions leave the ea->i, ei-^a — subspace invariant (we worked indeed within this subspace in 
the rest of the paper). The next step is therefore to expand for small perturbations ej-^-'„(/i) 
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FIG. 6: Cavity field distribution pi^a{h) of 3-SAT, averaged over all the directed links of the factor 
graph. Here we used /x = 1.75 (upper frame) and 2.25 (ower frame), and a = 4.51. The IRSB 
equations were solved by a population dynamics algorithm with 4000 populations of 256 fields each. 

and e^^j(ii). The resulting linear equations have a simple invariant subspace: 

?i2.H=^a2.e'^H, (20) 

and analogously for e^^^{h) (with parameters 8^^^^). One can therefore deduce a set of 
hnear recursions for the parameters ^^Jj, ^U^. It turns out that, both for fc-SAT and for 
/c-XORSAT, these recursions are equivalent to the ones obtained in the previous Sections 
for the 2RSB perturbations. Under the assumption that Eq. (20) defines the most relevant 
(unstable) subspace, this implies that stability with respect to non-integer fields is indeed 
equivalent to stability with respect to 2RSB perturbations. 

For finite we analyzed this instability numerically. As an example, in Fig. 6 we report 
the results of a numerical solution of the IRSB equations for 3-SAT at a = 4.51 > aQ. Here 
we used T = 10~^ and IRSB parameter n = 1.75 and 2.25, which should be confronted 
with the ground-state value /Xs(q^ = 4.51) = 1.94(1). The first choice of fi corresponds to 
metastable states, while the second to an energy below the ground state. It is clear form 
the figure that /i — 1.75 is in the unstable region while /i — 2.25 is in the stable region. 

In fact the distributions pi-^a{h) or pa^i{u) acquire a non- vanishing support on non- 
integer fields as soon as < Hint{ot) (he. for energy e > eint(Q;)). A precise numerical 
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FIG. 7: Distributions e^^^('u) of non-integer cavity fields for 3-SAT, averaged over all the directed 
links of the factor graph. Here we used a = 4.51 and fi = 1.9 < and normalized the integral 
of e^^j(u) to 1. The continuous line is a fit to the expectated form (5* exp(/x|'u|), cf. 20. We found 
the value (5* ^ 0.351 for the best fitting coefficient. 

determination of /lintio^) is not simple because the solution of the cavity equations at finite 
temperature is a rather slow process. Moreover many systematic effects must be taken into 
account. As mentioned above consistency implies that yUint(ct) < f^G{(^)- Furthermore, we 
argued /Xmt(a) = /iG(tt)under the assumption that Eq. (20) defines indeed the most relevant 
perturbation. Our numerical best estimates give /Xint(4.51) = 2.00(3). This is numerically 
compatible with the result obtained with the methods of Sees. II and III: /iG(4.51) = 
2.045(5). 

Finally in Fig. 7 we present our numerical data for the average of the distributions pa^iiu) 
at a = 4.51 and p = 1.9 < yUint(ct). If the analytical argument outlined above is correct and 
in the approximation that |/iint — Ai| ~ 0.10 <^ 1, we should have e^^j(M) ~ 5* cxp(^|-u|). The 
resonable agreement confirms that Eq. (20) corresponds to the most relevant subspace for 
finite-T perturbations. 
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V. CONCLUSION 



Our main conclusion is that FRSB plays an important role in random combinatorial op- 
timization problems such as /c-XORSAT and /c-SAT. We investigated this issue by analyzing 
the stability of the cavity recursions, both within a 2RSB ansatz, cf. Sees. II and III, and at 
finite temperature, cf. Sec. IV. 

The IRSB ground state becomes unstable in two different regimes. In the UNSAT region, 
it becomes unstable in highly constrained problems: a > etc, i.e. when the corresponding 
factor graph has large connectivity. This result was not unexpected. As shown in Refs. [19] 
(for A;-XORSAT) and [23, 24] (for 3-SAT), in the a ^ oo hmit, these models have a low 
temperature FRSB phase. In the SAT region there is an exponential number of unfrustrated 
ground states (i.e. solutions of the satisfiability problem). The IRSB solution indicates that 
these solutions have a clustered structure in the region < ex < a^- However, this solution 
becomes unstable in the underconstrained region < a < ctm. Providing a more refined 
description of the space of solutions in this regime is an open problem (which will require 
presumably FRSB). 

Let us recall that high-lying metastable states are always unstable against FRSB. This 
could have remarkable consequences on the performances of local search algorithms (such as 
simulated annealing). Let us suppose, just to estimate how large this effect can be, that there 
are no metastable states above the instability energy cq^o). This would imply that the total 
number of metastable states at the SAT-UNSAT phase transition is E(eG(Q;c), etc) ~ 0.0019 
(for 3-SAT) and 0.0099 (for 4-SAT), instead of T,{e^{a^), a^) ^ 0.010 (for 3-SAT) and 0.029 
(for 4-SAT) . In other words metastability would start having some effect only at much larger 
sizes. 

In this work we studied the stability of the IRSB phase, by analyzing the stability of 
the cavity recursions with respect to two types of perturbations. In Sees. II and III we 
considered a perturbation towards 2RSB, while in Sec. IV we used a perturbation towards 
non-integer fields. We argued that the two approaches give indeed coincident answers, cf. 
Sec. IV. This leaves open the questions whether there can be more dangerous instabihties. 
In replica formalism, one should diagonalize the Hessian of the free energy in the full replica 
space. We expect that our calculation corresponds to selecting one particular subspace. The 
question is whether this is the most dangerous subspace. The fact [18] that in the o; — > oo 
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limit our calculation yields the replicon instability points towards a positive answer 
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APPENDIX A: EXPLICIT FORMULAE 



In this Appendix we give the exphcit forms of the recursions (8), (9) and (10) for the 
models treated in Sec. III. Moreover we show how to reduce the size of the 6x6 matrices 

T,t\ and T;S, 

using the symmetries of the models. Finally, it will become evident that 
the stability parameter A depends uniquely upon the smallest replica-symmetry breaking 
parameter fii. 

Before turning to the models of Sec. Ill, it is useful to compute the matrix 
M_^*^,(gi . . .Qi; 112), cf. Eq. (11), which is model-independent. We get the following result 



M^l,{qi...qi;fi2) = < 








> 1 or < 1, 


e-2'^2<5<,,+5,.,_ 


if E,>.i?.- 


= 1 and qi = 0, -F, 


e^/^^^^.+f^,,,- 


if ^j^i^j 


= 1 and qi — — , 


e-2^^5,,_5,,,+ 


if T.j^i^3 


= —1 and Q'j = 0, — 




if ^i^i'lj 


= -1 and qi = -F, 




if 


= 0. 



(Al) 



fc-XORSAT 



Let us start by recaUing that the function . . . p^^ ^^j takes in this case the form: 



1 



i=i 
fc-i 



i=l 



pi 



= i-n(p! 

1=1 

n(p?+p^^)-n(p?-p-) 



fc-i 



i=l 



(A2) 

(A3) 
(A4) 
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This completely specifies the 2RSB saddle point equations (2), (3). Moreover, it turns out 
that the IRSB solution is symmetric under spin inversion: r^^^^ = ^^'^ — 

[14] . We can therefore parametrize it in terms of a single real number per directed link, e.g. 



r 



(0) ^0) 



Using this simplifying features it is easy to show that the matrices Tj 



(a) 
■>i' j^a 



have the following form: 



p(a) 
" 6— »i 



Ci C2 Cs 

Ci 

Gi C5 

C5 C4 

Ci 

C3 C2 Ci 



7^(0 _ 



1/2 1/2 

1/2 1/2 
C C 

c d 
1/200 1/2 
1/20000 1/2 



(A5) 



where we ordered the 6 components as follows {q, a) = {(+, +), (+, — ); (0, +), (0, — ); (— , +), 
(—,—)}. The constants Ci,...,C5 are easily computed using Eqs. (11) and (Al), while 
C — Cj-!i„ is given by 



C 



1 ''^j^aYlleda\{i,j}i^ ^Ha) 



j-*a 



1 



[I 



JO) . 



(A6) 



As we already pointed out, the 6-dimensional transformation defined above can be re- 
duced thanks to the symmetries of the system. Consider indeed the following parametriza- 
tion of the fluctuation variables in terms of the numbers 5,-^„ : 



I— >a 
(0)+ 

(-)+ 



0, 



.(-)- 



(A7) 
(A8) 
(A9) 



and the analogous for e^^'^ (in terms of Si^a)- It is easy to show that the linear subspace 
defined in this way is preserved by the transformations (9), (10). Moreover, a numerical 
calculation confirms that the largest eigenvalue A belongs to this subspace. Therefore, 
instead of Eqs. (9), (10) we can iterate the simpler recursion: 



b^di\a 



jEda\i 



(AlO) 
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The real numbers t^^]^- and can be derived from the matrices and T^^]^^. The result 
is 

- ^rr/. n (^k-l-l) (All) 

{qc} cGdi\{a,b} 

n (1--SJ> (A12) 

l£da\{i,j} 

where the sum is over the {gd such that '^cedi\{a 6} ?c = or 1, and 2;[{fc_»j; /ii] is defined 
as in Eq. (4) and discussion below. Notice that the above expression no longer depend upon 

A*2- 



2. A;-SAT 

Once again, the first step consists in assigning the (model-dependent) function 
P^Ip^^K . . p^''~^^] entering in Eq. (3). Unlike for /c-XORSAT, this function depends upon 
the quenched variables Ja-*i- We have 

K^,{Ja^^) = n Pj^ai-Ja^j) , (Al3) 

%^.(0) = 1 - n Pj^ai-Ja^j) , (A14) 

jEda\i 

Pl^i(-Ja^i) = 0, (A15) 

where, for greater clarity, we used the notations p{q) and p{q), instead of Pg and Pg for 
indicating the arguments of the distributions p and p. Obviously, the IRSB solution (8) 
has the property that f^^j = for = —Ja-^i- The distributions Ta-^i can therefore be 
parametrized by giving a single real number: for instance 

Let us now consider the fluctuation parameters e^-^'^'^ and e^!^'^. The flst important obser- 
vation consists in noticing that, because of Eqs. (A13)-(A15), e^'^'^ = if c = —Ja^i or 
q — —Ja-^i- Using the form of the transformation Tj[^j, this implies e^^~ — e^^'^ — 0. We 
are therefore left with 4 parameters ej_>a's and 2 ea->i's different from zero. 

In order to write explicit forms for the transformations (9) and (10), it is convenient to 
parametrize the remaining e^-^a's as follows: 

^ - (e--^-/rii) , = {l/r^J S^t , (A16) 

^- = (e--.Vr!l) St]; , 4t = {Vrfl; • (A17) 
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Analogously we parametrize the non-zero ei^l'^'s in terms of ^^^s. We are now in position 
to write the explicit form of the transformations (9), (10) in a compact form. In this case it 
is more convenient not to use the matrix notation. We get: 

ei" = E 4i(o) + E sTi- . (A18) 

66r+ 6er_ 

= E + E . (A19) 

beT+ 6er_ 

= E + E 4i.(o) , (A21) 

6er+ 6er_ 
where we used the shorthand — {b E di\a : Jf,^i — a}. As for Eq. (10), we get 

= E n (i-r^JS^t", (A22) 

j£da\i l£da\{i,j} 

m = E n d-'-sj*™;-''. (A23) 

j£da\i lGda\{i,j} 

where we used the shorthands Jj, Jj for (respectively) Ja-^i and Ja-^j- The last thing which 
remains to be specified are the coefficients t^^-lii^) entering in Eqs. (A18)-(A21): 

ttlM - ,rrp \ , 1 E n (^^e-'^^')- (^24) 

As for fc-XORSAT, the recursions (A18)-(A23) can be further simplified by restrict- 
ing them to a particular linear subspace. Notice in fact that the subspace 6^^^ = S^'^^, 
(—)— (0)— )J '^0)J 

(^i_>a — ^i-Sa 1 ~ ^o--*?"^ ' prcscrvcd by the above transformation. A numerical 

calculation confirms that it contains the largest eigenvalue. A further simplification occurs 
as //i — > oo, since in this limit i[^^(±l) — > 



APPENDIX B: fe-XORSAT: EXPANSION NEAR THE DYNAMIC TRANSITION 

In this Appendix we focus on XORSAT and expand both ed{oi) and 60(0) for a — > a^- 
This provides us with an analytic characterization of the dynamic transition. 

Throughout this Section, we shall work within the random A;- XORSAT ensemble defined 
in Sec. III. 
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1. Dynamic energy: ed{a) 



Before dwelling upon the calculation, let us recall some well known relations valid within 
a IRSB approximation. The complexity can be obtained as the Legendre transform of the 
replicated free energy [25] : 



d 

E(e) = //e - , e = —[ii(j){fj,)] . 



(Bl) 



Since e^icK) J, as a J, a^, we are interested in the zero-energy (large /i) limit of the above 
expressions. In this limit the free energy admits an expansion of the form: 



4/x 



(B2) 



which implies 



1 / e 
E(e) = -00 - - e log 



(B3) 



The dynamical energy (and the corresponding replica-symmetry breaking parameter) is 
defined as the location of the maximum of the complexity. It is therefore easy to obtain 



4 / j,2\ 
2) ) 



^Vo(0?/02). 



(B4) 



Let us now turn to the case of random /c-XORSAT. The IRSB variational free energy 
reads 



//0(//) = ka 



JdP{r) JdP{r) 1( 

k r k 

-a ffldP{r^^) log l + i(e-2'^-l)n(l-r®) 

1=1 L j=i 

oo „ I 

U^pi^'^) log 

1=0 i=l 



.qi-Ql j=l 



(B5) 



where pi = e'~^'^{ka)^ /l\ is the connectivity distribution of the variable nodes in the factor 
graph. The order parameters r and r are symmetric distributions over {-|-, 0, — } (which 
can therefore parametrized using a single real number) and represent the distribution of 
the cavity fields. The functions P{r) and P{r) are their distributions with respect to the 
disorder. 
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As shown in Refs. [13] and [14] it is important to distinguish the "core" of the factor 
graph. Outside the core the cavity fields are trivial: rq — Vq — Sq^. We rewrite [14]: 



P[r] = uF[r] + {l-u) S[r - S^^^] , 
P[r] = uF[r] + {l-u) S[r - S^^^] , 

where the parameters u and u satisfy the self-consistency equations 



(B6) 
(B7) 



u — u''^, u—l—e 

These equations have a non-trivial solution u,u > ior a > ad- 
Plugging the decomposition (B6), (B7) into Eq. (B5) we get: 

1 



—kau 



(B8) 



= kauu dF{r) dF(r) log 



-av!" lY[dF{r^^) log 1 + ^(e"''^ - 1) JJ(1 - rf] 

i=l . 1=1 



-(1-e- 



oo „ I 

''nJ2fi U^Hr^^) log 

1=1 1=1 



.qi-H »=1 



, (B9) 



where /; — (e'^"^" — l)~^{kauy/U is the connectivity distribution inside the core. The IRSB 

saddle-point equations can be obtained by differentiating the above expression with respect 
to the distributions F(r) and F(r): 

oo „ I 

F{r) = J2fi mdHr^'^) ^[r - ■ • ■ , (BIO) 



=1 " i=l 



F(f) = YldFir^"^) 5[r- p^[r^^^ . . .r^*^"^)]] . 



(Bll) 



i=l 



The saddle point equations imply that, as // — > oo, F{r) and F{r) are supported over 
'^0)^0 — 0{e~^^). In particular we get 

Using these results, one can expand Eq. (B9) for // — > oo. We get the form (B2) with 
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(the first two coefficients were already derived in [14]): 



0o(a) = -[kauu - au'' - kau + {1 - e-''''^)]\og2 , (B13) 
(j)i{a) = -q;k*^ + ^(M)^e-'="", (B14) 



1 - 2kau + - {kauf 
2 



+ 



4^ ' u[l - k{k - l)a{l - u)u''-^] ^ ' 

It is easy to check that both (f)o{a) and (f)i{a) have finite fimits 0o,d and 0i,d as o; J, ctd. On 
the other hand, in the same hmit, ^2(0;) = 02,d(Q; — ctd)"^/^ + with 

' 4^ y2(A; - l)Q;d[A;(A; - l)aaUd - {k - 2)] ^ ^ 

where we defined Wd = hniQ^Q,^ u, Ud = hnia^Q,^ u. Using these expressions in Eq. (B4), we 
recover the first of the two results in (16) with ef^ = 0^ jj/(402,d)- Moreover 

/.d(a) = -\ log(a - «d) - ^ log + 0((a - a^fl') . (B17) 

One can define one more instability threshold /Xi^i(a) such that the IRSB solution 
becomes unstable within the IRSB space itself for /i < iii^i{a). For /i < iii^i{a), the IRSB 
saddle point equations cannot be any longer solved by a population dynamics algorithm. 
One has, obviously, iii^i{a) < iiaioi)- More surprisingly, force > a^, Hdi^^) < A*i-+i(Q!)- This 
implies that the first expression in Eq. (16) cannot be directly tested against the results of 
a population dynamics calculation. 



2. Stability threshold: ecia) 

In order to compute the stabihty threshold, it is helpful to restrict ourselves to the core as 

in the previous Section: the fiuctuation parameters ei_»a and ea-»i vanish outside. Moreover, 

we can work with the "reduced" recursion (AlO). It is natural to consider the behavior of 

the joint probability distributions F{r,S), F{r,S) under the recursions (8) and (AlO). In 

analogy with Eqs. (BIO), (Bll), we obtain 

00 „ I I 
F{r,6) = Y,fi l[ldF{r^'\py) 6[r - p'[{r^'^}]] S[6 - ^ t»[{f<^')}]?»] , (B18) 
1=1 1=1 1=1 

Jc-l k-l 

F{r,S) = / JJ(iF(r»,5(')) S[r- p'[{r(^)}]] S[6 - ^ t^')[{r(^)}]5»] , (B19) 



i=l 
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where the coefficients i^^^f. . .] and t^^^[. . .] are easily computed using Eqs. (All) and (A12). 
Alternatively these equations could have been derived by "projecting" Eqs. (2) and (3). 

Notice that the marginal distributions F{r) and F{r) satisfy the Eqs. (BIO), (Bll). 
Therefore, if /x — oo, F{r,S), F{r,S) arc supported on ro,fo = 0(e~^^). As for 6, 6 two 
cases are possible: either their support shrinks to (and therefore the IRSB solution is 
stable) or it remains distinct from 0. This can be checked by looking at the average value 
of S, S with respect to the above distributions. Using Eqs. (B18), (B19), we get 

oo I fe— 1 

1=1 1=1 i=l 

We are interested in the regime a I a^, /^i T with e~'^^ ~ (a — aa). This can be 
checked to be the correct scahng at the end of the computation. If we expand the above 
equations in this limit, we get 

{5)f = [/i + 2/2(e-'^i + 2(fo)p)] {5)p + 0{e-"^^) , (B21) 
(5)p = {k - 1)[1 -{k- 2){ro)F] (<5«)f + 0{e~'^^) . (B22) 

which imply the marginality condition 

{k - 1)[1 -{k- 2)(ro)F][/i + 2/2(e-'^i + 2(ro)p)] = 1 + 0{e-'^^) . (B23) 

Notice that (ro)^ and (fo)^ are formally of order e^^'^i, cf. Eq. (B12) but since 1 — (/c — l)/i = 
0{a—ad), they must be in fact considered of order e~'^^. The relation can be inverted yielding 

/^g(«) = ~ log(a - ad) - log A + 0((a - aa)'/') , (B24) 

where 

A = ~ """^ y/2{k - l)aMk - l)c^d^d - {k - 2)] , C - 1 + a/s - , ,f ^ ~ ■ 
C"d«d y k{k - l)Q;dMd 

(B25) 

Plugging this result into the general relations (Bl), (B2), we get the second result in Eq. (16), 
with eg) = -2A^ct>^4- 
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